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Abstract 

In 2010, gynecologic malignancies were the 4th leading cause of death in U.S. women and for patients with 
extensive primary or recurrent disease, treatment with interstitial brachytherapy may be an option. 
However, brachytherapy requires precise insertion of hollow catheters with introducers into the tumor in order to 
eradicate the cancer. In this study, a software solution to assist interstitial gynecologic brachytherapy has been 
investigated and the software has been realized as an own module under (3D) Slicer, which is a free open source 
software platform for (translational) biomedical research. The developed research module allows on-time processing 
of intra-operative magnetic resonance imaging (iMRI) data over a direct DICOM connection to a MR scanner. 
Afterwards follows a multi-stage registration of CAD models of the medical brachytherapy devices (template, obturator) 
to the patient's MR images, enabling the virtual placement of interstitial needles to assist the physician during the 
intervention. 



Introduction 

In 2010, gynecologic cancer - including cervical, endo- 
metrial, and vaginal/vulvar types - is with over 80,000 
new cases and over 25,000 deaths the 4th leading cause 
of death in women in the United States (American Can- 
cer Society 2010). However, depending on the type and 
stage of the cancer, different treatment approaches may 
be performed, like radiation including a course of 
brachytherapy for patients with extensive locally ad- 
vanced or recurrent pelvic disease. Hereby, brachyther- 
apy enables the placement of radioactive sources direct 
inside the cancerous tissue that deliver very high doses 
of radiation and for interstitial gynecologic brachyther- 
apy, catheters are guided into place through holes in a 
so called template (Figure 1, left) sutured to the patient's 
perineum. Viswanathan et al. conducted a first prospect- 
ive trial of real-time magnetic resonance image (MRI)- 
guided catheter placement in gynecologic brachytherapy 
in a 0.5T unit (Viswanathan et al. 2006, 2013), and Lee 
et al. in a computed tomography (CT) brachytherapy 
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suite (Lee and Viswanathan 2012; Lee et al. 2013). In 
the meantime, the benefit of using magnetic resonance 
imaging scans to guide brachytherapy planning has 
been shown in other gynecologic cancer brachytherapy 
centers around the world and a CT/MR comparison 
showed that MR contoured volumes are narrower than 
CT (Viswanathan et al. 2007). As a result of this, the 
highest dose regions (D90 and D100) and the tumor 
volume that receives 100% dose (V100) can be increased 
and a T2-weighted MRI is therefore considered the 
gold standard for target delineation in image-based 
cervical cancer brachytherapy (Viswanathan et al. 2011). 
In Viswanathan et al. the dosimetric and clinical gains 
from using MRI, CT or ultrasound (US) have also been 
described in detail and in summary the ability to more 
accurately delineate tumor and surrounding normal 
tissue is the primary benefit in using 3D compared to 
the more standard practice of x-ray. Subsequent, this 
leads to a more precise dose escalation to the target 
volume while at the same time respecting dose constraints 
for the surrounding organs at risk (OAR). Furthermore, 
CT may not be possible to distinguish the cervical tumor 
from the surrounding normal tissues such as small bowel 
in CT acquisitions. In contrast, MR can determine in such 
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Figure 1 Two medical devices used for interstitial gynecologic brachytherapy: the template (left) is sutured to the patient's perineum 
and afterwards catheters are guided into place through template's holes. The obturator (right) is inserted through the large hole in the middle 
of the template into the vaginal canal (amongst others for better template stabilization). The 3D CAD models in STL format are freely available for 
download: https://github.com/xjchen/igyne/tree/master/scene for template and obturator for template and obturator. Last accessed on March 2014. 



cases the size, location, and paracervical involvement of 
the tumor and its relations to the applicator. 

Other working in the field of radiation therapy to sup- 
port cervical cancer treatment are Staring et al. (2009). 
Staring et al. addressed the registration of cervical data 
using mutual information (MI) of not only image inten- 
sity, but also features that describe local image structure. 
The presented algorithm was compared to a standard 
approach, based on the mutual information of image in- 
tensity only showing that the registration error can be 
improved at important tissue interfaces, like the bladder 
with the clinical target volume (CTV), and the interface 
of the rectum with the uterus and cervix. Krishnan and 
Sujatha (2010) worked on the segmentation of cervical 
cancer images using Active Contour Models (ACM) 
(Kass et al. 1987, 1988), and introduced a method for 
automatic extraction of object region and boundary from 
the background for cell nucleus segmentation of cervical 
cancer images. Therefore, the method starts computing 
a threshold based on the clusters automatically calcu- 
lated by a K-means clustering algorithm, whereby the 
cluster center of this threshold region, acts as a seed for 
further processing. Ultimately, the object region is ex- 
tracted from the object boundary and a gray scale clus- 
ter. A method for simultaneous non-rigid registration, 
segmentation, and tumor detection in MRI-guided cer- 
vical cancer radiation therapy using a unified Bayesian 
framework has recently been introduced by Lu et al. 
(2012). The presented framework can generate a tumor 
probability map while progressively identifying the bound- 
ary of an organ of interest based on the achieved non- 
rigid transformation. In addition, the framework is able 
to handle the challenges of significant tumor regression 
and its effect on surrounding tissues and the proposed 
methods help with the delineation of the target volume 
and other structures of interest during the treatment of 
cervical cancer with external beam radiation therapy 
(EBRT). However, the purpose of this contribution is 
to investigate a research software to support 3D-guided 



interstitial gynecologic brachytherapy during the intra- 
operative stage and to the best of our knowledge such a 
tool has not yet been described and there is no commer- 
cial software currently available. The software exists as a 
free module available under 3D Sheer, which is an open 
source software platform for biomedical research and 
research highlights include linking a diagnostic imaging 
set in real-time to a 3D CAD model of the template 
(Figure 1, left) and the obturator (Figure 1, right), which 
enables the identification of catheter location in the 
3D imaging model with real-time imaging feedback. 
Furthermore, the introduced software allows patient- 
specific pre-implant evaluation by assessing the place- 
ment of interstitial needles prior to an intervention 
via virtual template matching with a diagnostic scan 
(note: this contribution relates to a previously published 
work in SpringerPlus (Egger 2013). There, an overall 
image-guided therapy system for interstitial gynecologic 
brachytherapy in a multimodality operating suite was 
introduced). 

The rest of this article is organized as follows: Section 
2 presents the material and the methods. Section 3 pre- 
sents the results of our experiments, and Section 4 con- 
cludes and discusses the paper and outlines areas for 
future work. 

Materials and methods 

This section describes the Material and Methods that 
have been used for this study, resulting in an open 
source software module for enhanced visualization dur- 
ing MR-guided interstitial gynecologic brachytherapy. 
Thereby, this section starts with a paragraph about the 
Equipment, Data and CAD Models that have been used 
for this study. Afterwards, the software platform 3D 
Slicer (Sheer) is introduced, within the new software 
module has been realized. In the next paragraph the 
Software Design for the module is presented. Finally, the 
last paragraph of this section describes the detailed Ap- 
plication Workflow for the presented software module. 
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Equipment, data and CAD models 

The Advanced Multimodality Image-Guided Operating 
(AMIGO) suite at Brigham and Women's hospital 
(BWH) allows intraoperative 3 Tesla MR imaging and 
has been used to develop and test the introduced soft- 
ware module for enhanced visualization during MR- 
guided interstitial gynecologic brachytherapy. Moreover, 
the intraoperative MRI (iMRI) data used for this study 
(acquired in AMIGO) is freely available for download 
(Egger J, Kapur T, Viswanathan AN, GYN Data Collec- 
tion, The National Center for Image Guided Therapy) 
(Kapur et al. 2012): 

http://www.spl.harvard.edu/publications/item/view/2227. 
Last accessed on March 2014. 

The CAD models like the interstitial template and the 
vaginal obturator (Figure 1) needed for the software 
module (see section Application workflow) have been 
generated using a CAD software from SolidWorks 
(Dassault Systemes SolidWorks Corp., MA). Therefore, 
the gynecological CAD models have been reverse- 
engineered by measuring the precise dimensions from 
the clinically devices and afterwards converted to an in- 
dustry standard format (STL). These models are also 
available online: 

https://github.com/xjchen/igyne/tree/master/scene for 
template and obturator. Last accessed on March 2014 

3D Slicer 

The introduced software of this contribution has been 
developed within 3D Slicer or Slicer (http://www.slicer. 
org/), which is a free and open source software platform 
for visualization and image analysis (Pieper et al. 2004, 
2006; Surgical Planning Laboratory (SPL) 2014) and a 
detailed review of the current capabilities of Slicer has 
been recently been published by Fedorov et al. (2012). 
Slicer is a cross-platform software, which can be used 
for different biomedical research tasks like visualization, 
segmentation, registration, volume measurements and 
network communications via DICOM (e.g. direct to a 
scanner or PACS systems). Several of these tasks are 
implemented within Slicer as own modules, like the 
Volume Rendering module, the DICOM module, the 
Change Tracker module (Konukoglu et al. 2008) and the 
EM Segmentation module (Rannou et al. 2009; Pohl 
et al. 2007). This modular concept allows researchers 
and programmers to develop software modules for new 
tasks and provide them to the community. Slicer realizes 
the Model-View-Controller (MVC) design pattern and 
therefore the classes which implement the core of 3D 
Slicer, as well as loadable modules, are organized into 
three main groups (Fedorov et al. 2012). As common for 
the MVC pattern, the data organization and serialization 
is handled by the Model. Thereby the Model is supported 
by the Medical Reality Markup Language (MRML), which 



defines the hierarchies of the data elements and the APIs 
for accessing and serializing the individual nodes. Further- 
more, a C++ class library is used to instantiate the MRML 
nodes and organize them into a coherent internal data 
structure called the MRML scene, which maintains the 
links between the individual data items, their visualization 
and any other persistent state of the application and mod- 
ules. The visual elements of the application are provided 
by the View to the user. The functionality consists of the 
Graphical User Interface (GUI) and displayable manager 
classes of the Slicer core, which maintain consistency be- 
tween the internal MRML state of the Model and the vis- 
ual appearance of the GUI. The processing and analysis 
functionality of the application core is encapsulates by the 
Controller and does not depend on the existence of GUI. 
However, it is fully aware of the MRML data structures, 
and the communication between the View and the Con- 
troller takes indirecdy place through changes in MRML 
data structures. In addition, the Controller uses the 
MRML nodes for storing the computation results and the 
View receives event updates from the MRML scene and 
individual nodes, which then update the visualization 
elements. 

Software design 

This research software module has been developed as a 
first step for assisting in MR-guided gynecologic brachy- 
therapy in a multi-modal operating suite like AMIGO. 
The high level design of the software module is shown 
in Figure 2; two components (GUI and Logic) are cre- 
ated for observing changes in the MRML scene and for 
processing events (Fedorov et al. 2012; slicer.org/slicer- 
Wiki/index.php/Documentation/4.1/Developers/MRML 
2012). Thereby, the software module for MR-Guided 
Interstitial Gynecologic Brachytherapy, has been devel- 
oped as an own loadable module for Slicer (note: details 
on different mechanisms of writing Slicer extension 
modules, including loadable modules are available in 
(Fedorov et al. 2012)). 

Application workflow 

Figure 3 shows the diagram of the presented module 
consisting of the workflow and functions for the en- 
hanced visualization during MR-guided interstitial gyne- 
cologic brachytherapy (green), the relevant modules that 
have been used from Slicer4 (blue) and the supporting 
algorithms and techniques (orange). The workflow starts 
with loading of the MR image data and the CAD 
models, and ends with the selection of the interstitial 
needles and is described in detail as follows: 

1. Loading of Applicator CAD models and MR images: 
The CAD models for the template and obturator are 
loaded from disk while the patient is imaged in the 
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Figure 2 The overall infrastructure of the software module: two components (GUI and Logic) are created for observing changes in the 
Medical Reality Markup Language (MRML) scene and for processing events. 



MR scanner. When imaging is complete (with the 
template sutured to the perineum and the obturator 
placed in the vaginal canal), the acquired images are 
automatically transferred to this module via the 
Slicer DICOM module. 

Initial registration of CAD model of the Template to 
MR images: A rigid registration (or transformation) 
between the CAD model of the template and its 
appearance in the MRI is computed in two steps. 
First, the user uses the mouse to identify three 
clearly visible landmarks in the template in the MRI 
scan (as shown in Figure 4). The registration 
transformation is computed using the closed form 
solution to the absolute orientation problem (Horn 
1987). This step is accomplished using the following 
three modules in 3D Slicer: the "Annotations" 
module for manual marking of landmarks by user, 
and the "Fiducial Registration" and "Transforms" 
modules for obtaining the rigid registration between 
corresponding sets of points. 
Registration Refinement: The initial registration 
obtained above is refined using additional points on 
the superior surface of the template (the surface that 
is in contact with the patient perineum). The points 
on this surface of the CAD model are computed 
using the locations of the holes. The points on this 
surface in the MRI scan are obtained interactively 
from the user; the user is first prompted to create a 
rough region of interest that encompasses the 
template, and then to provide a threshold that 
highlights (approximately) the very bright surgical 
lubricant filled template holes in the MRI. This set 
of points is also overlaid as a 3D surface on top of 
the CAD model, to allow the user to visualize the 



agreement between the two. The registration 
refinement method is the Iterative Closest Point 
(ICP) algorithm (Besl and McKay 1992), which 
computes the least-squares distance between two 
sets of point clouds. The ICP algorithm is described 
as follows (Xiaojun et al. 2007). 

ICP Registration: Suppose the two point sets under 
the CAD template model and MR image coordinate sys- 
tem are respectively P = {p„ i = 0,1,2,. ..,kj, and U = {iij, i = 
0,1,2,... ,nj, then: 

• Compute the closest points: For each point in U, 
compute the corresponding closest point in P that 
yields the minimum distance. Let Q denote the 
resulting set of closest points, P = {q b i = 0,l,2,...,nj. 

• Compute the registration between U and Q via the 
quaternion-based least squares method so that 
rain y~J|qj-(i?u,- + r)|| 2 , where R is 3 x 3 rotation 
matrix, and T is 3 x 1 translation matrix. 

• Apply the registration, i.e. let U\ = RU + T. 

• Compute the mean square error between Ui and Q, 
and terminate the process if it falls below a preset 
threshold e > 0 specifying the desired precision of 
the registration, otherwise, perform the iteration 
with the substitution of U\ for U. 

The modules of 3D Slicer used in this step are: "Model 
Maker" to create a 3D surface model from the thre- 
sholded image using the Marching Cubes algorithm 
(Lorensen and Cline 1987). 

4. Visualization of Registration: The registration results 
are provided for easy visual inspection by displaying 
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functions of iGyne 



Relevant modules of Slicer4 



Supporting algorithms 
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Figure 3 Diagram of the presented module consisting of the workflow and functions for the enhanced visualization during MR-guided 
interstitial gynecologic brachytherapy (green), the relevant modules that have been used from Slicer4 (blue) and the supporting 
algorithms and techniques (orange). The workflow starts with loading of the MR image data and the CAD models, and ends with the selection 
of the interstitial needles. 



the intersections of the template and the obturator 
with the 2D axial, sagittal, and coronal planes. If this 
result is not visually satisfactory, the capability of 
manual refinement is also available. 
These steps are accomplished using the "Model" and 
"Transforms" module in 3D Slicer. 



5. Image Segmentation: To allow the user to visualize 
the 3D renderings of the applicator in the context of 
the tumor and organs of interest, the tumor, bladder, 
and rectosigmoid can be manually or semi- 
automatically segmented in the MR scan using the 
Slicer modules: "Editor", "Robust Statistics 
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Figure 4 The three corresponding point pairs (red) used for an initial registration: the left image shows the user-defined landmarks in 
the MR image, the right image shows corresponding landmark positions in the CAD model of the template. 



Segmenter" (Gao et al. 2012) or "Grow Cut 
Segmenter" (Vezhnevets and Konouchine 2005). 
6. Needle Selection and Display of Virtual Needles 
relative to Applicator CAD models and Tumor 
Segmentation: After the reconstruction of the 3D 
model of the tumor, virtual needles that originate 
from the template and penetrate the tumor can be 
automatically selected by the module using a 
collision detection algorithm based on OBB 
(Oriented Bounding Box) trees (Gottschalk et al. 
1996). For the triangular mesh of each needle model 
and the tumor model, OBB trees are constructed 
top-down, by recursive subdivision, and each leaf 
node of the OBB tree corresponds to a single 
triangle in the mesh. Effectively an OBB of the 
tumor model is compared against an OBB of each 
needle model. If the two OBBs intersect, then the 
children of the second OBB are compared against 
the current OBB of the first tree recursively, until 
the contacting cells are found. This process is 
conducted for each virtual needle, and the needles 
whose trajectory intersects with the tumor are 
selected. Finally, the selected virtual needles are 
automatically annotated on a schematic of the 
template (that is displayed in the user interface) and 
rendered in the 2D and 3D views, with the insertion 
depth independently adjustable for each needle. This 
allows for ease of visualization of spatial relationships 
among the needles, tumors, and surrounding 
anatomical structures. 

Results 

During this study, a first free and open source research 
software module for the 3D Slicer platform supporting 
MR-guided interstitial brachytherapy of gynecologic cancer 



has been investigated. The principle of the module has been 
pre-published in a recent research disclosure (Egger et al. 
2012a), however, algorithmic details are presented in this 
publication. The software module and the interface is 
illustrated in the screenshots of Figures 5 and 6. The two 
screenshots show the CAD models of the interstitial tem- 
plate (blue) and the obturator (green) which have been 
fitted to intraoperative MRI scans of AMIGO patients. 
In more detail, Figure 5 presents a refined registration 
result of the template and the obturator, in an axial 
(upper left window), a sagittal (lower left window), a cor- 
onal (lower right window) and a 3D view (upper right win- 
dow). In Figure 6, the manual segmented tumor is also 
visualized (brown) and on the left side of the interface the 
interstitial planning sheet is provided that allows virtual 
pre-planning of the depth and length of single interstitial 
needles. In this case, several needles (pink and green) 
around the obturator have been pre-planned to target the 
tumor. Furthermore, the software module enables render- 
ing of the pre-planned interstitial needles in different 2D 
slices (right side of Figure 6). The software module has 
been developed in C++ under Visual Studio (Version 9) 
and in our implementation the planning could be per- 
formed within a few minutes on a Laptop with Intel Core 
i5-2520M CPU, 2 x 2.5 GHz, 4 GB RAM, Windows 7 Ver- 
sion, Service Pack 1, 32Bit. Moreover, the module is open 
source and public available as a loadable module for Slicer: 

https://github.com/xjchen/igyne. Last accessed on March 
2014 

Note: in the meantime there has been a study about 
catheter segmentation for MR-Guided gynecologic can- 
cer brachytherapy which uses the successor of our soft- 
ware module (Pernelle et al. 2013): 

https://github.com/gpernelle/iGyne. Last accessed on 
March 2014 
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The dataset used for the screenshots of Figures 4, 5 
and 6 is available from: 

https://github.com/xjchen/igyne/tree/master/Sample% 
20data. Last accessed on March 2014 

Conclusions 

In this contribution, we introduced a research software 
module to support interstitial gynecologic brachyther- 
apy. The module has been implemented and tested 
within the free open source software platform for bio- 
medical research, called 3D Slicer (or just Slicer). The 
implementation and workflow of the designed Slicer 



module has been described in detail and research high- 
lights include: 

• on-time processing of intra-operative MRI data, 

• a multi-stage registration of a template 

• and the virtual placement of interstitial needles. 

The presented software module allows on-time pro- 
cessing of the intra-operative MRI data realized via a 
DICOM connection to the scanner. Afterwards, a multi- 
stage registration of the template and the obturator to 
the patient's dataset enables a virtual placement of 
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interstitial needles to assist the physician during the 
intervention. 

Areas for future work include the enhancement of the 
registration method by using the obturator as well as 
additional physical markers that can be (semi-)automat- 
ically detected by image processing. Another area of fu- 
ture work includes the integration of intra-operative 
navigation, like intraoperative ultrasound (iUS), electro- 
magnetic (EM) tracking or optical navigation via the 
OpenlGTLink network protocol (Tokuda et al. 2009; 
Egger et al. 2012b) to support applicator guidance (note: 
in contrast to interventions in the male pelvis where 
navigation systems have been used (Tokuda et al. 2008; 
Fischer et al. 2008) medical navigation systems have not 
yet been successfully introduced for gynecological inter- 
ventions). Furthermore, we plan a (semi-)automatic seg- 
mentation of the organs at risk (OAR) with a graph- 
based approach (Egger et al. 2011a, 2012c) that we have 
already applied to the bladder (Egger et al. 2010, 2011b), 
and the integration of a real-time dose calculation en- 
gine (Cormack et al. 2000; Haie-Meder et al. 2005; 
Potter et al. 2006). 
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